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Abstract 

Background: The mental health needs of young children in hunnanitarian contexts often rennain unaddressed. The 
lack of a validated, rapid and simple tool for screening combined with few mental health professionals able to 
accurately diagnose and provide appropriate care mean that young children remain without care. Here, we present 
the results of the principle cross-cultural validation of the "Psychological Screening for Young Children aged 3 to 6" 
(PSYCAa3-6). The PSYCa 3-6 is a simple scale for children 3 to 6 years old administered by non-specialists, to screen 
young children in crises and thereby refer them to care if needed. 

Methods: This study was conducted in Maradi, Niger. The scale was translated into Hausa, using corroboration of 
independent translations. A cross-cultural validation was implemented using quantitative and qualitative methods. 
A random sample of 580 mothers or caregivers of children 3 to 6 years old were included. The tool was 
psychometrically examined and diagnostic properties were assessed comparing the PSYCa 3-6 against a clinical 
interview as the gold standard. 

Results: The PSYCa 3-6 Hausa version demonstrated good concurrent validity, as scores correlated with the gold 
standard and the Clinical Global Impression Severity Scale (CGI-S) [rho = 0.41, p-value = 0.00]. A reduction procedure 
was used to reduce the scale from 40 to 22 items. The test-retest reliability of the PSYCa 3-6 was found to be high 
(ICC 0.81, CI95% [0.68; 0.89]). In our sample, although not the purpose of this study, approximately 54 of 580 
children required subsequent follow-up with a psychologist. 

Conclusions: To our knowledge, this is the first validation of a screening scale for children 3 to 6 years old with a 
cross-cultural validation component, for use in humanitarian contexts. The Hausa version of the PSYCa 3-6 is a 
reliable and a valuable screening tool for psychological distress. Further studies to replicate our findings and 
additional validations of the PSYCa 3-6 in other populations may help improve the delivery of mental health care 
to children. 



Background mental health professionals in these settings also hinders 

The mental health needs of young children in humani- the implementation of mental health activities [5]. Fur- 
tarian contexts often remain unaddressed [1-4]. During ther, even when mental health professionals are present, 
the acute phase of a humanitarian emergency, and in they are rarely specialists in young children. Psycho- 
humanitarian contexts in general, psychological care of logical distress in young children is particularly difficult 
children may come far down on the list of priorities. to evaluate by non-specialists, requiring knowledge of 
The limited number of both local and international normal child development, as many behaviors are nor- 
medical professionals combined with the relative lack of mal at certain ages but not at others. Young children, 

between 3 and 6 years old, are in a vulnerable psycho- 
logical period, which can have consequences on the 
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children depends on their individual, family, and social 
environments among many other factors, recognizing 
the diversity of potential psychological responses is es- 
sential to provide appropriate interventions [8-10]. The 
training and infrastructure needs in children's mental 
health remain the ultimate goal, but in their absence, 
tools that help identify children who require further as- 
sessment would help to rationalize scare resources and 
orient children to care in humanitarian contexts. 

The lack of cross-culturally valid instruments, and data 
about child psychological difficulties, is a public health 
concern in humanitarian contexts [2,11-14]. Although 
scales exist for general psychological difficulties, none of 
them concern children aged 3 to 6 years in humanitarian 
contexts [15-17]. Further, before use, screening tools 
should be cross-culturally validated for specific contexts 
[11,18-20]. Difficulties with mental health assessment in- 
clude lack of consistent assessment tools for measuring 
psychological distress, lack of cross-cultural validation 
research and variation in methods for validity testing 
and differences in methods of translation [21]. Typically, 
examining mental health cross -culturally involves simply 
transposing Western assessment tools with no examin- 
ation of their validity [22] . As result, children remain un- 
screened or evaluated using a scale not designed for 
either the specificities of childhood psychological distress 
or the context. The lack of a validated, rapid and simple 
tool for screening, combined with few mental health 
professionals able to accurately diagnose and provide ap- 
propriate treatment, mean that young children may re- 
main without appropriate care. 

In addition, interest in humanitarian settings has fo- 
cused primarily on trauma rather than other disorders 
or psychological difficulties [1,12,23-25], adding also 
that most of such studies were implemented in con- 
flict affected settings. This focus is based on the as- 
sumption that exposure to violence frequently entails 
post- traumatic symptoms [12,26]. This premise has 
been criticized recently, as well as the use of only a 
post-traumatic scale for screening [11,27]. Research 
addressing the cross-cultural validity of Western diag- 
nostic classification of psychological difficulties in such 
contexts remains essential to ensure appropriate care 
is provided [11,28-31]. Recent research has shown the 
importance of tools able to detect and orient children 
in need, but has focused on children older than 6 years 
with an emphasis on post-traumatic stress disorder 
[22,32-35]. In addition to PTSD, recent studies have 
also shown the importance of addressing depression 
and anxiety disorders [35]. 

Our aim was to begin to respond to one of the gaps in 
addressing the mental health needs of young children in 
humanitarian contexts. Although there are many valid 
models of screening, evaluation and care, the need for a 



simple, rapid screening scale administered by non- 
specialists would fill one of the many gaps in responding 
to the mental health needs of young children in humani- 
tarian contexts. We report the results of a study to 
cross -culturally adapt and assess the reliability, validity 
and psychometric properties of the Psychological 
Screening for Young Children aged 3 to 6 (PSYCa 3-6) 
following cross-cultural validation. Although the PSYCa 
3-6 had been validated in several populations [36,37], it 
had never undergone but had never undergone a rigor- 
ous cross-cultural validation process. 

The entire validation process for the PSYCa 3-6-22 
includes three steps, one called principal, including a 
large sample, and two called secondary, implemented to 
strengthen the results. The principle validation will be 
presented here. The overall process including the three 
steps will be the purpose of another publication. Selec- 
tion of study sites were based on the political context 
and the population of children expected to be exposed 
to conflict to facilitate the evaluation of the post- 
traumatic component of the screening scale. 

Methods 

Setting 

The principal validation took place in the rural region of 
Maradi, located in the south of Niger along the Nigerian 
border. This population is mainly Hausa speakers living 
in villages interspersed with Fulani and Touareg camps. 

Study population 

The rationale for the selection of this population 
included the language itself as well as the prevalence of 
psychological distress. First, Hausa is one of the 
principle languages of Sub-Saharan Africa, spoken by an 
estimated 30 to 50 million people. Although common 
language does not imply common culture, by selecting a 
commonly spoken language, the possibility of the use of 
the scale improved. Second, we expected a lower preva- 
lence of post-trauma in this Hausa population than in 
other in post-conflict contexts. At the time of the study, 
the political environment was stable we could consider 
that young children had not been exposed to country- 
wide conflict. This was an important factor as the tool 
should be useful not only in situations of conflict or 
post-conflict. Niger faces recurrent food insecurity and 
malnutrition is chronic [38,39]. Validation of a tool in 
Hausa, covering multiple registers, could be useful in 
this context. Finally, existing partnerships with the 
Ministry of Health of Niger provided the possibility of 
wide-scale use of the tool within the health system after 
validation. This was an important consideration provid- 
ing the possibility of improving the mental health care 
of children in Niger. 
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Tool 

The "Psychological Screening for Young Children aged 3 
to 6" (PSYCa 3-6) is an indicative tool, not designed for 
diagnosis, but rather to determine a general level of psy- 
chological distress in children 3 to 6 years old. It is a 
hetero-questionnaire completed by the parent or care- 
giver through an interviewer. Unlike existing generalist 
tools, the PSYCa 3-6 includes a psycho-traumatic com- 
ponent. Data collected through the PSYCa 3-6 allows 
for the inferences of psychological difficulties and their 
main register of expression: depression, phobia, anxiety, 
regression, psychosomatic complaints, and post- 
traumatic disorder. The PSYCa 3-6, in its initial version, 
included 40 items concerning child behavior in the form 
of easy questions caregivers answer by never/not at all, 
or sometimes/a few times or often/frequently/always. 
For example, "Does your child have bad dreams or 
nightmares often?" Each interviewer, which may be non- 
specialists, read the questions and score depending to 



the response. At the end of administration, responses 
are summed to compute a score ranging from 0 to 80 
with higher scores indicating greater distress. Developed 
in French in 1999 for Albanian and Kosovar child refu- 
gees in Macedonia, the tool has been subsequently 
refined and improved [37,40]. The results of a prelimin- 
ary validation in France on 52 children, showed promis- 
ing results but no formal validation of the scale has been 
conducted [36] [Table 1]. 

Adaptation and translation 

The adaptability of the tool was discussed with experi- 
enced mental health professionals and anthropologists 
originating from Niger or who had done research in the 
country. A linguistic and cultural translation of the tool 
was performed from French to Hausa. Ideally, several bi- 
lingual persons (same fluency in the two languages and 
experience with mental health instruments) are used to 
obtain translations and blind back translation [41,42]. 



Table 1 Reduced version of PSYCa 3-6 - 22 

The modality of response was 0, 1 or 2 (never, sometimes, often) for each item 



0 1 2 1. The child stutters 

0 12 2. The child refuses to eat repeatedly 

0 12 3. The child wakes up frequently, insomnia 

0 12 4. The child is absent, seems somewhere else or in "his world", 

has difficulties to interact with you 

0 12 5. The child had a bad dream or a nightmare that comes often 

0 12 6. The child is frightened, worried, anxious 

0 12 7. The child has difficulty to be clean (pee, poop) 

0 12 8. The child refuses to separate with one of his parents, siblings etc. 

0 12 9. The child eats too much 

0 1 2 10. The child does not speak or very little, his language is very 

different from children of his age 

0 1 2 11. The child refuses to eat certain foods and chooses 

what to eat at every meal 

0 1 2 12. The child has difficulty falling asleep 

0 1 2 13. The child has outbursts, have uncontrolled movements 

for no apparent reason 

0 12 14. The child complains of pain or complains about his body 

without obvious medical reason 

0 1 2 15. The child is unable to sit still, he moves constantly 

0 1 2 16. The child refuses to leave the household 

0 1 2 17. The child is tired, discouraged 

0 1 2 18. The child's behavior is really too aggressive, he is violent 

(at home and / or outside) 

0 1 2 19. The child isolates himself or often moves away from others 

0 1 2 20. The child is easily overwhelmed by his emotions anger, 

sadness fraternal jealousy etc. 

0 1 2 21. The child plays repetitive games or activities 

0 1 2 22. The child runs away or avoids sounds, images or specifics situations 
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Here, two professional translators (Hausa/French) trans- 
lated the tool independently. The two resulting versions 
were compared and the few differences were resolved. 
The translated tool was then administered to a small 
group of caregivers in a pilot phase for acceptance, ad- 
equacy and applicability [43]. A list containing misun- 
derstood items developed and an alternate proposed 
translation was made. The final version was fixed by the 
two translators consensus taking into account differ- 
ences between spoken and written Hausa. 

Focus group discussions with community key infor- 
mants, individual interviews and expert meetings were 
conducted during adaptation and translation phase. 
Focus groups helped to elucidate understanding of the 
beliefs and perceptions about child development and 
expectations of the outcome of treatment [44,45]. They 
were also conducted to ensure understanding of each 
of the scales items and enhance the quality of the 
clinicians' diagnosis during the validation phase (see 
methods) [46] and ensure that misclassification was 
minimized [47-49]. Variations in clinical presentation 
of psychological distress may lead to misidentification. 
Cultural variations, social interactions and specific con- 
textual factors vary cross-culturally, and might influ- 
ence the experience, representation, expression of 
psychological difficulties [50]. Consultations with psy- 
chiatrists and anthropologists and the health care staff 
of the hospitals in Niamey (the country's capital) and 
Maradi to define developmental milestones and child 
psychopathology were also organized. 

Training 

All interviewers were selected by meeting the main cri- 
teria, experience in questionnaire administration, fluent 
in Hausa and French and without a background in men- 
tal health. They were trained over a three-day period on 
how to administer the questionnaire. After a general 
presentation of the tool, items were presented and dis- 
cussed one by one. Role-plays were used to simulate 
interviews and training provided on the information and 
informed consent procedure. Interviewers were also 
trained on study exclusion criteria. The exclusion criteria 
for interviewers were based on visible, recognizable diffi- 
culties and interviewers were trained on the basics of 
mental retardation and the severe classifications of the 
ICD-10. A one-day pilot phase followed the theoretical 
training to assure standardization of administration and 
reinforce the theoretical training. The translator partici- 
pated in the interviewer s training and also performed an 
additional day of training on the translation process it- 
self [51]. Interviewers were supervised during the dur- 
ation of data collection to respond to any difficulties or 
questions. 



Sampling 

The study population included a random sample of 580 
caregivers recruited between November 2009 and July 
2010. A comprehensive information and awareness cam- 
paign was organized before study implementation to in- 
form the population about the aims and objectives of 
the study. Caregivers were selected using cluster-based 
sampling, with population proportional to size weight- 
ing, a standard methodology in populations where popu- 
lation data is either limited or inaccurate [52]. Within 
the region, 68 villages or city districts were randomly 
chosen (22 districts in Maradi city, and 23 villages each 
in the districts of Madarounfa and Guidan Roumdji) 
[53]. The random sample in the villages followed the 
traditional method by spinning a pen, as random starting 
direction from a central location in the cluster. House- 
holds lying on this transect from the center to the 
border of the cluster were counted and then one of them 
was chosen at random. Proximity selection was then 
used to select subsequent households as the "next near- 
est" until the desired sample size was reached [52,54]. 

In each household, caregivers needed to have at least 
one child aged 3 to 6 years old, be Hausa speakers, and 
resident in the study area (Maradi city, Madarounfa, 
Guidan Roumdji). As mothers were the most 
knowledgeable of the daily activities and behaviors of 
children, they were asked to respond to the question- 
naire. Children identified by the mother/caregivers as 
presenting a mental disorder, mental retardation, devel- 
opment disorder, and/or psychosis were excluded. Inter- 
viewers also excluded children who met visible, 
recognizable criteria of mental retardation or grave de- 
velopment disorders. These children were referred im- 
mediately for free care. All mothers and caregivers were 
read an information letter describing the study and 
asked for written informed consent before enrollment. 

Study procedures 

The first phase of the study consisted of administration 
of the tool to 325 mothers and caregivers. The aim of 
this phase was to collect data to examine the psychomet- 
ric properties of the tool, reliability and test-retest reli- 
ability before proceeding further with the validation (see 
data analysis). A total of 201 children completed the 
PSYCa 3-6 once to evaluate internal consistency, 51 
completed the PSYCa 3-6 twice for temporal stability, 
and 51 completed the PSYCa 3-6 twice with two differ- 
ent interviewers for interrater reliability. During the 
morning, each interviewer included 7 to 8 children 
meeting the inclusion criteria. At midday, the inter- 
viewers met and exchanged children. Each interviewer 
had to provide all needed information for his colleague 
to find the children selected. Interrater reliability was 
measured by re- administering PSYCa3-6 independently 
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on the same day at different times by two interviewers. 
The timeframe of re-administration was the same. The 
day started including 7 to 8 children, after administra- 
tion, caregivers were given an appointment for the same 
day in the afternoon with the same interviewer. 

In the second phase of the study, the interviewer 
administered the tool and this was followed by a clin- 
ical evaluation as the gold standard for 255 children. 
The psychologist completed the Clinical Global 
Impression-Severity Scale (CGI-S), a seven-point sever- 
ity scale, assessing a patients current symptom severity, 
and answered the question "does the child need psy- 
chological/psychiatric care?". The CGI-S is used widely 
in medical care and clinical research because of its face 
validity and practicability with the same wording irre- 
spective of the pathology [55,56]. The clinician also com- 
pleted a semi-structured clinical interview, and 
performed a diagnosis based on ICD-10 classification 
[33,57]. The psychologist was under the supervision of a 
senior clinical psychologist. In case of psychopathological 
disorders, specific psychological care consisting of indi- 
vidual based care were provided at home. Mental health 
care providers in the area were informed of the study and 
were aware of any referrals for additional care [Figure 1]. 

Two clinical psychologists carried out the individual 
interviews (CM, YM), trained in child development and 
cross-cultural psychology. Each individual interview was 
a direct and confidential. For each interview, the transla- 
tor was present. Clinical psychologists were blinded to 
the score of the tool (administered immediately prior). 



Data analysis 

First, using data collected in phase I, psychometric prop- 
erties were analyzed. We performed a descriptive ana- 
lysis (missing data, scatter-plot of responses, floor and 
ceiling effects) and redundancy (estimation of Pearson s 
correlation coefficient between items two by two). 

Internal consistency of the PSYCAa3-6 was evaluated 
by Cronbachs alpha for the entire scale. Test-retest and 
interrater reliability were estimated using intra-class cor- 
relation coefficients (ICC). Kappa statistics were used to 
calculate the degree of interrater agreement for each 
question. 

Second, in phase II, external validity was tested on 255 
children by comparing the reported PSYCa 3-6 scores 
against the clinical psychologists' evaluation, answering 
to the question "Does the child need psychological/psy- 
chiatric care?".To strengthen the results, PSYCa 3-6 
total scores were correlated with CGI-S scores. Receiver 
Operating Characteristic (ROC) curve analyses were per- 
formed to evaluate the PSYCa 3-6 screening properties 
and determine an optimal cut-off. Kruskal-Wallis tests 
were used to assess the association between PSYCa 3-6 
scores and each child's socio-demographic characteris- 
tics. The cut off for of 17 was based on prior use of the 
scale prior to its validation. 

Third, an expert panel consisting of a child psych- 
iatrist, research psychologists and a statistician reviewed 
the results and discussed item reduction; which items 
should remain, be further modified, and those to be 
removed (item reduction and clarification). Criteria for 
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Figure 1 Study flow-chart. 
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removal was based on the clinical importance of the 
item in this population and in others, the number of 
items covering the same clinical domain, readability, 
relevance, redundancy, and on psychometric criteria 
(floor effect, inter-item correlation, reliability and con- 
current validity). We used R software (version 2.10.0) for 
all analyses. Item reduction and the factor analyses will 
be presented in a forthcoming manuscript. 

Ethical considerations 

The protocol was submitted for approval to the National 
Consultative Ethics Committee of Niger, Ministry of 
Public Health of Niger and the Committee for the Pro- 
tection of Persons (CPP) He de France XI. After 
informed consent was obtained, caregivers were asked to 
answer the questionnaire. The consent process included 
two documents, an information sheet and consent form, 
both translated in Hausa. Patient data were confidential 
unless it was deemed necessary to protect the health of 
the patient. The electronic database contained no names 
or addresses of patients to ensure their anonymity. Chil- 
dren requiring psychological care received appropriate 
and free care by a clinical psychologist. The PSYCa 3-6, 
once validated, will be made available to all health actors 
who wish in Niger. 

Results 

In total, 580 children participated in the study. From De- 
cember 2009 to February 2010, 325 children (160 males 
(49.2%) and 165 females (50.8%), mean age 52 months) 
were included. A total of 201 children completed the 
PSYCa 3-6 once to evaluate internal consistency, 51 
completed the PSYCa 3-6 twice for temporal stability, 
and 51 completed the PSYCa 3-6 twice with two differ- 
ent interviewers for interrater reliability. From May 2010 
to July 2010, 255 children were included for the evalu- 
ation of diagnostic properties (123 males (48.2%) and 
132 girls (51.8%), mean age 52 months) [Table 2]. The 
item reduction procedure yielded a 22-item instrument 
(scores 0-44) and results are presented as follows. 

In the population of 580 children, the proportion of 
missing data or "I don't know" response per item was 
low (average 1.6%, <5% for all but 4 items) suggesting 
good acceptability and that it was easy to complete. 
With the exception of item 21 ("moves constantly"), the 
distribution of answers was left-skewed with a higher 
floor rather than ceiling effect reflecting the low trau- 
matic exposition of this sample. The mean PSYCa 3-6 
scores were 7.13 (SD = 3.95, interquartile range 4-9, min 
0 max 27). There was no significant difference between 
the PSYCa 3-6 scores of boys and girls (p = .16), or be- 
tween children 36, 48, or 60 months of age (p = 0.5) but 
scores on the PSYCa 3-6 were significantly higher for 
children who were detected by their own family as 



Table 2 Characteristics of children included in the study, 
Maradi, Niger, 2010 

Socio-demographics (n=580) 
Gender 

Girls 297 (51.8%) 

Boys 283 (48.8%) 
Age (months) 

36-47 214 (36.9%) 

48-59 194 (33.4%) 

60-72 1 72 (29.7%) 
Live most of the time with 

Both parents 491 (85.2%) 

One parent 42 (7.3%) 

Someone else 43 (7.5%) 

Go to school* 358 (62.0%) 

Number of siblings i 4 (3-6) 

Number of deceased siblings i 1 (0-2) 

Data are median (IQR) or numbers (%). 
* school, nursery school or day nursery, 
t same father and same mother. 

having difficulties such as fears, outbursts, sleep disor- 
ders, recurrent nightmares problem and were oriented 
to a traditional practitioner (p = 0.0002). 

The test-retest reliability of the PSYCa 3-6 was found 
to be high (ICC 0.81, CI9% [0.68; 0.89]). Interrater reli- 
ability was satisfactory (ICC of 0.69, CI 95% [0.45; 0.80]). 
The tool demonstrated acceptable internal consistency 
(Cronbachs alpha 0.61, CI 95% [0.54; 0.65] for a screen- 
ing tool validation including several dimension (depres- 
sion, anxiety, post traumatic component) [20,58]. 

During the second phase, psychologists identified 31 
children in need of psychological orientation and 224 
children not requiring care. Concerning the CGI-S scale 
among these 255 children, 187 (73.3%) were rated as 1 
"normal, not at all ill", 29 (11.4%) with borderline CGI, 
23 (9%) mildly ill, 12 (4.7%) moderately ill, 4 (1.6%) 
markedly ill. None were rated as severely or extremely 
ill. Overall, the 255 children evaluated by psychologist 
had a mean CGI-S of 1 [1; 3] for the children without 
orientation and 4 [2; 5] for children oriented towards 
additional assessment (p < 0.001). The PSYCa 3-6 exhib- 
ited significant positive correlations with CGI severity 
scale (rho = 0.41, p-value = 0.0001). Mean PSYCa 3-6 
scores were significantly higher among the 31 children 
requiring care than those that did not (p-value = 0.0001 
[Table 3]). The frequency of positive responses to 
twenty-two items in children requiring care and in other 
children is shown Figure 2. The ROC analysis resulted 
in an area under the curve of 0.81 (CI 95% [0.73, 0.89]) 
[Figures 2, 3 and 4]. When the cut-off value of PSYCa 
3-6 was nine according to the point closest to the upper 
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Table 3 PSYCa 3-6 scores comparisons between groups 



Clinical interview (n=255) 



PSYCa 3-6 score* p-value+ 



CGI 

normal 
borderline 
mildly ill 

moderately ill or more 

Does the child need 
psychological/psychiatric care? 

No 

Yes 



<0.0001 



6.53 (3.28) 
8.28 (3.17) 
10.17 (3.85) 
12.56 (4.34) 



6.86 (3.35) 
1 1 .58 (4.27) 



<0.0001 



* mean (SD). 

+ Wilcoxon rank sum test. 



left-hand corner of the graph, the sensitivity and specifi- 
city were 0.77 and 0.71, respectively [59]. 

Discussion 

To our knowledge, this is the first validation of a screen- 
ing scale for children aged 3 to 6 years old, with a cross- 
cultural validation component, for use in humanitarian 
contexts. The PSYCa 3-6 enables the rapid screening of 
children and can be administered by non-specialists. 
The results of this study suggest that the Hausa version 
of the PSYCa 3-6 is a reliable and a valuable tool for 
screening psychological distress in children 3 to 6 years 
old. The tool was acceptable to caregivers and inter- 
viewers (after training and piloting). The sample of 
patients for this validation was large compared to other 
validation studies further strengthening our results 
[13,37,42,60]. 

Screening tools provide an important means to facili- 
tate addressing the mental health needs of children in 
humanitarian emergencies and contexts. Difficulties of 
young children may remain unnoticed or undetected by 
both local and international health actors [61] and may 



have short and/or long term developmental conse- 
quences [8,45,62,63]. Screening children provides a 
means to identify those in need of additional evaluation 
and eventual care as well as recognizing the limited 
resources available in these contexts. The reduction 
from a 40 to 22-item scale also provides additional en- 
couragement that the scale could be administered to an 
often large number of children in a relatively short 
period of time. The simple administration of the screen- 
ing scale also provides additional awareness and under- 
standing of the overall status of the population for 
health care workers addressing the situations. In hu- 
manitarian contexts, a part from the acute phase of an 
emergency, the tool could also be used to identify diffi- 
cult to reach children (due to either distance or isolation 
for example) and refer only those in need of additional 
evaluation to health structures. However, it is important 
to highlight that this tool allows for the identification of 
children requiring further evaluation, but the lack of 
mental health professionals remains. As with all public 
health interventions, identification of children in need 
does not unfortunately always follow with their receipt 
of appropriate care. Greater investments are needed to 
ensure that children mental health needs are addressed, 
and certainly that they are only screened if appropriate 
care is available [64,65]. 

We would like to highlight two key points for discus- 
sion, especially relevant for future validation studies. 
First, the translation process was long and involved a lin- 
guistic specialist, anthropologist, psychiatrist and psych- 
ologist. We first attempted a classical translation/back 
translation procedure [13,42,66-70], but due to signifi- 
cantly differences concerning written and spoken Hausa, 
we used independent translations resolved by discussion 
and pilot testing. 

Second, due to the lack of previously cross-cultural 
validated scales in Hausa, we chose to use a classic 
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individual interview by a psychologist as our gold stand- 
ard [47,69,70]. Two major types of assessment of mental 
disorders are used in epidemiological studies: semi struc- 
tured clinical interviews and lay- administered structure 
diagnostic questionnaires [71]. To date, there has not 
been agreement the most appropriate validation method 
for global mental health research with children 
[22,42,72,73]. Although use of a clinical interview 
appeared here the most rigorous choice in this context 
as opposed to using another tool. The psychologist, 
trained in cross-cultural psychology and mental health 
care in children based their diagnosis on ICD-10 classifi- 
cation. To strengthen the clinical interviews, qualitative 
research concerning child development, child rearing, 
psychological difficulties in Hausa culture was conducted 
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Figure 4 Receiver operating characteristics (ROC) curve of the 
PSYCa 3-6. 



[35]. Concordance between the clinical interview and 
the PSYCa 3-6 suggest that use of the ICD-10 did not 
influence the results presented here. 

An apparent limitation is that we do not present a 
traditional psychometric validation. The traditional val- 
idation process (item analysis, factor analysis, etc.) of a 
psychometric tool was developed in the absence of a 
gold standard [74]. The objective of the PSYCa 3-6 is to 
screen subjects who need further evaluation for psychi- 
atric/psychological care. In an ideal situation, the clin- 
ician decides, after an interview, if such a care is 
required. Our gold standard was the clinicians answer 
to the question: "does the child need psychological/psy- 
chiatric care?". For this reason, we validated the PSYCa 
3-6 as compared with the above question and classical 
statistics. Most other screening tools in medicine are 
based on the same methodology; this is the case for ex- 
ample for scores of gravity in intensive care units such 
as the APACHE score [75], validated against mortality 
rather than with psychometric tools. After secondary 
evaluations have been completed, the factor structure of 
the PSYCa 3-6, corresponding to different clinical con- 
ditions should be investigated. The internal consistency 
may be viewed as a limitation from a psychometric per- 
spective. However, as the PSYCa 3-6 is a screening tool 
for psychological difficulties, the scale is not one- 
dimensional to ensure the detection of psychological dif- 
ficulties in several area of psychopathology. As the 
PSYCa 3-6 includes several domains, this is not 
unexpected. 

An additional limitation concerns the test-retest and 
interrater reliability. Both were estimated from inter- 
views performed on the same day. Time between the dif- 
ferent interviews is problematic since short interval are 
prone to recall bias, while long intervals risk being 
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associated with the dinical evolution of the subject 
evaluated. 

Finally, we used initially a cut-off of 17, based on the 
results of previous use of the scale [36,40]. This number 
was calculated on 40 items, the initial version, scoring 
up to 80 (2 points per item). As previously documented, 
cut-off scores established with Western child popula- 
tions are not necessarily comparable in others settings 
[27,43]. After reduction of the scale and analysis, we 
refined the cut-off to 8/9. The cut-off requires further 
analysis in subsequent validations to assure stability in 
other cross-cultural contexts. 

Conclusions 

The results of this first validation show promising results, 
suggesting that the PSYCa 3-6 should be validated in 
other contexts, to test the post-traumatic component of 
the tool and to simplify further the instrument. From a 
public health standpoint, the ability to identify potential 
psychological difficulties in young children represents a 
significant advancement for the possibility of addressing 
children's' mental health needs in difficult contexts [76]. 
Additional efforts to adapt and validate simple screening 
scales for use in humanitarian contexts should be 
encouraged. 
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